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(54) IMAGE DECODING DEVICE 

(57) A lateral directional difference calculating unit 
21 calculates a change degree between pixel levels of 
pixels adjacent to each other through a boundary of a 
decoded block and a block adjacent to the decoded 
block in a lateral direction and calculates a change de- 
gree between pixel levels of pixels placed in the block 
adjacent to the decoded block in the lateral direction a 
lateral directional continuity judging unit 23 judges the 
continuity between the decoded block and the block ad- 
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jacent to the decoded block in the lateral direction. A 
longitudinal directional difference calculating unit 22 and 
a longitudinal directional continuity judging unit 24 are 
operated in the same manner, a block continuity judging 
unit 25 judges the continuity between the decoded block 
and each block adjacent to the decoded block, and an 
error macro-block judging unit 26 detects an error mac- 
ro-block according to a judging result of the block con- 
tinuity judging unit 25. 
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Description 

TECHNICAL FIELD 



5 [00011 The present invention relates to an image decoding apparatus in which an error partial image region which 
receives the influence of a bit error occurring in a coded bit stream, is detected in each of vanous types of .mage 
compressing and expanding methods. 

BACKGROUND AFU 

r0002] AS a method for effectively coding an image signal, as is adopted in MPEG-4 (Moving Picture Experts Group 
?hasi-4) wWch is currently in progress tov^ard standardization by ISO/IEC JTC11/SC29/WG11 ^« -^t-^o^. J ^ 
discrete cosine transformation (DCT) is performed for an image signal for each block and a vanable-lengtl^ coding .s 
perfomied for quantization-transfomnation coefficients obtained after a quant.zat.on of the .mage s'S^^'; « . 
15 [0003] AS is described above, on a decoding side, after a variable-length decoding is performed a ^od^d b^^ 
stream for each block of data, an inverse quantization and an inverse DCT are perfomied for the coded b.t stream, 
anTt'e codeTbit stream is reproduced as the image signal. In this decoding, there is a case that a e.or occurs m 
a variable-length code-word existing in a block data region. For example, in cases where the var.able-^ngth code- 
word in Which the bit error occurs, has a value defined in a predetemiined variable-length decod.ng table, because 
20 the vkriable-length code-word is decoded without detecting the bit error, an erred image signal .s reproduced. 

0004] Also, because data of each block has a variable-length, an end of data of the block cannot be specif .ed untn 
he dita of the block is decoded. In cases where a variable-length code-word is erroneously d^^^f^'th^^^ ^^^^'9^ 
possibility that the end of the data of the block is also erroneously specified, so that p.eces of data of blocks placed 
Ser Slock are erroneously decoded. In this case, the degradation of an image quality caused by the error .s 
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25 propagated to data of succeeded blocks. ^ ^ * r.^^r^r^\^ 

[0005] Because a conventional image decoding apparatus has a configurat.on descnbed above, for example 
cases where a bit error occurs in a block data region, because the decoding of coded data .s continued unt.l a value 
no^defTned in a variable-length decoding table is detected in the decoding, an image, which is obtained by erroneous y 
decoding pieces of data placed in a range from an error occurring position to an error detected pos^ion. is considerab y 
degrad^ Also, because the degraded image is used as a predicted image In the decodmg for obtain.ng one or more 
images of frames succeeding the frame of the degraded image, there is a problem that the decoded images of the 
succeeded frames are also degraded. u i ion 

[0006] AS a prior art relating to the above problem, there is a prior art disclosed 

anese Patent Application No. H7-1 54783 (1 995). In this specification, when p.eces of coded data of a part.cular block 
harg a presc^edsize are decoded, a change degree between each peripheral pixel of the particular block and each 
peripheral pixel of a block adjacent to the particular block is calculated, and an error ,s detected by comparing the 
Change degree with a prescribed critical value. However, there is a case that it is difficult to reliably detect the error 
accoSng to only the change degree between each peripheral pixel of the particular block and each peripheral p.xel 

40 So^^^^T^e pres°en't invention is provided to solve the above problem, and an object of the present invention is to 
obtain an image decoding apparatus in which a block relating to an error occurrence is reliably detected according to 
a statistical perfom,ance to suppress the degradation of an Image quality or the propagation of the error caused by 
the error occunrence to the minimum degree. 

45 DISCLOSURE OF THE INVENTION 

[0008] An image decoding apparatus of the present invention, in which a coded bit stream produced by compressing 
and coding an Input image signal for each partial image region is decoded, comprises part.a image region data de- 
coding means for decoding the coded bit stream for each partial image region, and en-orpart.al .mage region detecting 
means for calculating a first pixel level change degree between pixels adjacent to each other through a bounda-7 
between a decoded partial image region decoded by the partial image region data decoding means and a partial image 
region adjacent to the decoded partial image region, calculating a second pixel level change degree between pixels 
of the partial Image region adjacent to the decoded partial image region, and detecting according to the f.rs pixe eve 
change degree, the second pixel level change degree and a prescribed threshold value relating to the f.tst pixel leve 
change degree and the second pixel level change degree that the decoded partial image region is an error partial 
image region in which an influence of a bit error occurring in the coded bit stream is received. 
[0009] Therefore the error occurrence is reliably detected in an early stage, so that an error propagation or the 
degradation of an image quality caused by the error can be suppressed to the minimum degree. 
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roolOl In an image decoding apparatus of the present invention, the error partial image region detecting means 
calculates a first pixel level difference value between pixels adjacent to each other through the boundary betw/een the 
decoded partial Image region and the partial image region adjacent to the decoded partial image region, calculates a 
second pixel level difference value between pixels of the partial image region adjacent to the decoded partial image 
5 reqion calculates a third pixel level difference value between pixels of the partial image region adjacent to the decoded 
partiaMmage region, and detects the error partial image region according to a difference value between the first pixe 
level difference value and the second pixel level difference value, a difference value between the second pixel level 
difference value and the third pixel level difference value and the prescribed threshold value. 
[0011] Therefore, the error occurrence is reliably detected in an early stage, so that an error propagation or the 
w deqradatlon of an image quality caused by the error can be suppressed to the minimum degree. 

r00121 In an image decoding apparatus of the present invention, the error partial image region detecting means 
comprises threshold value control means for controlling the prescribed threshold value used for the detection of the 
error partial image region according to a quantization step size decoded from the coded bit stream. 
r001 31 Therefore, an erroneous judgment for a macro-block, in which an error occurs, can be avoided. 
15 001 4 An image decoding apparatus of the present invention, in which a coded bit stream produced by compressing 
and coding an Input image signal for each partial Image region is decoded, comprises partial Image region data de- 
coding means for decoding the coded bit stream for each partial image region, and en-or partial image region detecting 
means for calculating a representative value of a plurality of first pixel levels in a decoded partial image region decoded 
by the partial image region data decoding means, calculating a representative value of a plurality of second pixel levels 
20 in a partial image region placed in the neighborhood of the decoded partial image region, and detecting according to 
the representative value of the first pixel levels, the representative value of the second pixel levels and a prescribed 
threshold value relating to the representative value of the first pixel levels and the representative value of the second 
pixel levels that the decoded partial image region is an error partial image region in which an influence of a bit error 
occurring in the coded bit stream is received. 
25 [0015] Therefore, the error occurrence is reliably detected in an early stage, so that an error propagation or the 
degradation of an image quality caused by the error can be suppressed to the minimum degree. 
r00161 In an image decoding apparatus of the present invention, the error partial image region detecting means 
calculates an average of the first pixel levels as the representative value of the first pixel levels, calculates a plurality 
of averages of a plurality of groups of second pixel levels as a plurality of representative values of the plurality of groups 
30 of second pixel levels in a plurality of partial image regions placed in the neighborhood of the decoded partial image 
reqion and detects the error partial image region according to a difference between the average of the first pixel levels 
and the average of each group of second pixel levels and a prescribed threshold value relating to the differences. 
[0017] Therefore, the error occurrence is reliably detected in an earty stage, so that an error propagation or the 
degradation of an image quality caused by the error can be suppressed to the minimum degree. 
35 [00181 In an image decoding apparatus of the present invention, the error partial image region detecting means 
weights the difference between the average of the first pixel levels and the average of each group of second pixel 
levels according to a correlation between the decoded partial image region and the corresponding partial image region 
placed in the neighborhood of the decoded partial image region. . 
[001 9] Therefore, the error occurrence can be more reliably detected by considering the correlation with the partial 
40 imaqe reqion placed in the neighborhood of the decoded partial image region. 

[0020] An image decoding apparatus of the present invention, in which a coded bit stream produced by compressing 
and coding an input image signal for each partial image region Is decoded, comprises partial image region data de- 
coding means for decoding the coded bit stream for each partial image region, and en-or partial image region detecting 
means for calculating a first pixel level change degree between pixels adjacent to each other through a boundary 
45 between a decoded partial image region decoded by the partial image region data decoding means and a partial image 
reqion adjacent to the decoded partial image region, calculating a second pixel level change degree between pixels 
of the partial image region adjacent to the decoded partial image region, judging continuity between the decoded partia 
image region and the partial image region adjacent to the decoded partial image region according to the first pixel leve 
change degree, the second pixel level change degree and a first prescribed threshold value relating to the first pixe 
50 level change degree and the second pixel level change degree, calculating a representative value of a plurality of first 
pixel levels in the decoded partial image region, calculating a representative value of a plurality of second pixel levels 
in the partial image region placed in the neighborhood of the decoded partial image region, and detecting according 
to the judgment of the continuity between the decoded partial image region and the partial image region adjacent to 
the decoded partial image region, the representative value of the first pixel levels, the representative value of the 
55 second pixel levels and a second prescribed threshold value relating to the representative value of the first pixel levels 
and the representative value of the second pixel levels that the decoded partial image region is an error partial image 
region in which an influence of a bit error occurring in the coded bit stream is received. 

[0021] Therefore, the error occurrence can be more reliably detected, and the error judgment can be avoided. 
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[0022] In an image decoding apparatus of the present invention, the error partial Image region detecting means 
comprises threshold value control means for controlling the first prescribed threshold value and the second prescribed 
threshold value used for the detection of the error partial image region according to a quantization step size decoded 

from the coded bit stream. 

[0023] Therefore, an erroneous judgment for a macro-block, in which an error occurs, can be avoided. 
[0024] An image idecoding apparatus of the present invention, in which a coded bit stream produced by compressing 
and coding an input image signal for each partial image region is decoded, comprises partial image region data de- 
coding means for decoding the coded bit stream for each partial image region, and en-or partial image region detecting 
means for detecting according to a comparison between a decoded image signal decoded by the partial image region 
data decoding means and a predicted error signal that the decoded partial image region is an error partial image region 
In which an influence of a bit error occurring in the coded bit stream is received. 

[0025] Therefore, the detection of an error macro-block can be perfomned by using a correlation of the image signal 
in the time direction, an error can be detected in an early stage, and an error propagation or the degradation of an 
image quality caused by the error can be suppressed to the minimum degree. 

[0026] In an image decoding apparatus of the present invention, the error partial image region detecting means 
calculates a representative value of the decoded image signal and a representative value of the predicted error signal 
and detects according to the representative value of the decoded image signal, the representative value of the predicted 
error signal and a prescribed threshold value relating to the representative value of the decoded Image signal and the 
representative value of the predicted error signal that the decoded partial image region is the error partial image region. 
[0027] Therefore, the detection of an error macro-block can be perfomned by using a correlation of the image signal 
in the time direction, an error can be detected in an early stage, and an error propagation or the degradation of an 
image quality caused by the error can be suppressed to the minimum degree. 

[0028] An image decoding apparatus of the present invention, in which a media packet string including a coded bit 
stream produced by compressing and coding an input image signal for each partial image region is received and the 
coded bit stream is decoded, comprises partial image region data decoding means for decoding the coded bit stream 
for each partial image region, error partial image region detecting means for detecting according to a comparison 
between an image signal characteristic at a decoded partial image region decoded by the partial image region data 
decoding means and an image signal characteristic at one partial image region placed In the neighborhood of the 
decoded partial image region that the decoded partial image region is an error partial image region in which an influence 
of a bit error occurring In the coded bit stream is received, for each partial image region, and supervising means for 
supervising a bit error occurrence frequency in the reception of the media packet string according to an error detecting 
code included in the media packet string, wherein the error partial image region detecting means is controlled according 
to a supervising result of the supervising means. 

[0029] Therefore, in cases where the receiving conditions are good, the erroneous detection performed In the error 
partial image region detecting means can be avoided, a decoding operation stable as a whole can be performed. 
[0030] In an image decoding apparatus of the present invention, the error partial image region detecting means 
controls, according to the supervising result of the supervising means, a comparison condition used in the comparison 
between the image signal characteristic at the decoded partial image region and the image signal characteristic at the 
partial image region placed in the neighborhood of the decoded partial image region. 

[0031] Therefore, in cases where the receiving conditions are good, the erroneous detection performed in the error 
partial image region detecting means can be avoided, a decoding operation stable as a whole can be perfonned. 
[0032] In an image decoding apparatus of the present invention, the error partial image region detecting means 
controls, according to the supervising result of the supervising means, a size of each partial Image region in the detection 
of the error partial image region. 

[0033] Therefore, in cases where the receiving conditions are good, the erroneous detection performed m the error 
partial image region detecting means can be avoided, a decoding operation stable as a whole can be performed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0034] 

Fig. 1 is a diagram showing the structure of a texture data region of a coded bit stream of an M PEG-4 simple profile; 
Fig. 2 is a block diagram showing the configuration of an image decoding apparatus according to a first embodiment 
of the present invention; 

Fig. 3 is a block diagram showing an internal configuration of an error macro-block detecting unit according to the 
first embodiment of the present invention; 

Fig. 4 is a flow chart showing an operation of the error macro-block detecting unit according to the first embodiment 
of the present invention; 
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Fig. 5 Is a diagram explaining the processing of a lateral directional difference calculating unit and the processing 
of a longitudinal directional difference calculating unit according to the first embodiment of the present invention; 
Fig. 6 is a block diagram showing an internal configuration of an error macro-block detecting unit according to a 
second embodiment of the present invention; 
5 Fig. 7 is a flow chart showing an operation of a threshold value control unit according to the second embodiment 

of the present Invention; 

Fig. 8 Is a block diagram showing an internal configuration of an error macro-block detecting unit according to a 

third embodiment of the present invention; 

Fig. 9 is a flow chart showing an operation of the error macro-block detecting unit according to the third embodiment 
10 of the present Invention; 

Fig. 10 is a diagram showing a plurality of neighboring blocks, for which a difference calculation is performed, 
according to the third embodiment of the present invention; 

Fig. 11 is a block diagram showing an internal configuration of an error macro-block detecting unit according to a 
fourth embodiment of the present invention; 
15 Fig. 12 is a block diagram showing an Internal configuration of an error macro-block detecting unit according to a 

fifth embodiment of the present invention; 

Fig. 1 3 is a flow chart showing an operation of the error macro-block detecting unit according to the fifth embodiment 
of the present invention; 

Fig. 1 4 is a block diagram showing an internal configuration of an error macro-block detecting unit according to a 
20 seventh embodiment of the present invention; . 

Fig. 15 is a flow chart showing an operation of the error macro-block detecting unit according to the seventh 
embodiment of the present invention; 

Fig. 16 is a block diagram showing the configuration of an image decoding apparatus according to an eighth 
embodiment of the present invention; 
25 Fig. 1 7 is a diagram showing the configuration of a media packet string; and 

Fig. 1 8 is a block diagram showing the configuration of an error supervising unit according to the eighth embodiment 
of the present invention. 

BEST MODE FOR CARRYING OUT THE INVENTION 

30 

[0035] Hereinafter, the best mode for carrying out the present invention will now be described with reference to the 
accompanying drawings to explain the present invention in more detail. 

EMBODIMENT 1 

35 

[0036] I n this embodiment of the present invention, when an error occurs in a block data region of a coded bit stream, 
a block decoded without detecting the error is detected on the basis of the continuity of an image signal at an area 
neighboring on a block boundary. 

[0037] Fig. 1 is a diagram showing the structure of a texture data region of a coded bit stream of an MPEG-4 simple 
40 profile. In the MPEG-4, texture data of an object to be coded is coded for each of blocks which each are composed of 
luminance components of a 1 6*1 6 pixel size (called a "macro-block") and two types of color difference components of 
an 8*8 pixel size. The group of luminance components of the 16*16 pixel size is divided into a plurality of blocks 
respectively having the 8*8 pixel size, and DOT and quantization for the texture data are performed for each block of 
the 8*8 pixel size. In this specification, each block of the 8*8 pixel size in the "macro-block" is specifically called a 
45 "block" hereinafter. 

[0038] As shown in Fig. 1, a texture data region is composed of a plurality of macro-block data regions, and each 
macro-block data region is composed of a macro-block data header information in which a coding type of the macro- 
block and information of a motion vector are included, four pieces of luminance block data (Y), and two pieces of color 
difference block data (Cb and Cr). In this embodiment, when an error occurs in one macro-block data region, the macro- 

50 block relating to the error occurrence is detected in an early stage. 

[0039] Fig. 2 is a block diagram showing the configuration of an image decoding apparatus according to the first 
embodiment of the present Invention. In Fig. 2, 1 indicates a variable-length decoding unit for receiving a coded bit 
stream 101 and outputting a plurality of blocks of decoded data 102, a motion vector 103 and additional Information 
1 04. 2 indicates a motion compensating unit for receiving the motion vector 1 03 and outputting a predicted image 1 07 

55 by using a referential image 106 stored in a memory 3. 4 indicates a change-over unit for outputting the predicted 
image 107 or a "0" signal according to the additional information 104. 

[0040] Also, in Fig. 2, 5 indicates an inversely quantizing unit for receiving the blocks of decoded data 1 02 to perform 
an inverse quantization for each block of decoded data 102. 6 indicates an inverse DOT unit for receiving a plurality 
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of blocks of inversely quantized data 108 from the inversely quantizing unit 5. perfornning an inverse DCT for each 
block of Inversely quantized data 1 08 and outputting a predicted error signal 109. 7 indicates an adding unit for adding 
the predicted image 107 or the "0" signal received from the switching unit 4 to the predicted error signal 109 and 
outputting a decoded image signal 110. 

[0041] In addition, in Fig. 2. 8 indicates an error macro-block detecting unit (denoting an error partial image region 
detecting means) for receiving the decoded image signal 110. judging whether or not an error occurs in the decoded 
Image signal 110 and outputting an error macro-block judging result 111. 9 indicates a change-over unit for changing, 
according to the error macro-block judging result 111, a unit where the decoded image signal 110 is to be output 10 
Indicates a macro-block correcting unit for correcting the decoded Image signal 110. in which an error occurs, and 
outputting a corrected image signal 112. 11 indicates a partial image region data decoding means comprising the 
variable-length decoding unit 1 , the motion compensating unit 2, the memory 3, the change-over unit 4. the inversely 
quantizing unit 5, the Inversely DCT unit 6 and the adding unit 7. 
[0042] Next, an operation of the image decoding apparatus will be described. 

[0043] In the variable-length decoding unit 1 , a macro-block of data is extracted from the coded bit stream 1 01 . and 
a variable-length decoding is performed for the macro-block of data. In the motion compensating unit 2. a predicted 
image 107 is taken out according to a motion vector 103 decoded in the variable-length decoding unit 1 by referring 
to a referential image 106 stored in the memory 3. In the inversely quantizing unit 5, each block of decoded data 102 
decoded in the variable-length decoding unit 1 is inversely quantized. In the inversely DCT unit 6, each block of inversely 
quantized data 108 is received from the inversely quantizing unit 5, an inverse DCT is performed for the block of 
inversely quantized data 108, and a predicted error signal 109 is output. 

[0044] In the change-over unit 4, in cases where a macro-block type included in the additional information 104 de- 
coded in the variable-length decoding unit 1 indicates an intra-coding, a "0" signal is selected and is output to the 
adding unit 7. In contrast, in cases where the macro-block type indicates a coding other than the intra-coding, the 
predicted image 1 07 taken out in the motion compensating unit 2 is selected and is output to the adding unit 7. In the 
adding unit 7. the predicted image 107 or the "0" signal received from the switching unit 4 is added to the predicted 
error signal 1 09 received from the inversely DCT unit 6, and a decoded image signal 11 0 is output. Here, the decoded 
image signal 110 denotes a decoded macro-block and is composed of four luminance blocks and two color difference 
blocks. 

[0045] In the error macro-block detecting unit (that is, the error partial image region detecting means) 8, the decoded 
image signal 110 is received, it is judged whether or not the decoded image signal 110 exists in a decoded macro- 
block in which an error occurs, and an error macro-block judging result 111 is output. In the change-over unit 9. a unit 
where the decoded image signal 110 is to be output is changed according to the error macro-block judging result 111 
output from the error macro-block detecting unit 8. In cases where the error macro-block judging result 111 indicates 
that the decoded Image signal 1 1 0 is an error macro-block, the decoded image signal 1 1 0 is output to the macro-block 
correcting unit 10. In contrast, in cases where the en-or macro-block judging result 111 indicates that the decoded 
Image signal 110 is not an error macro -block, not only the decoded image signal 110 is output without any correction, 
but also the decoded image signal 110 is stored in the memory 3 to be used as another referential image 106. 
[0046] In the macro-block correcting unit 1 0, a processing for making the error of the error macro-block inconspicuous 
Is performed, and a corrected image signal 112 is output. As a most simple method, a macro-block, which is placed in 
the same position as that of an error macro-block judged to relate to an error occurrence, is taken out from the referential 
image 1 06 of the memory 3, and the error macro-block is replaced with the macro-block taken out. The corrected Image 
signal 112 obtained by correcting the decoded image signal 110 in the macro-block correcting unit 10 is output as a 
decoded image. Also, the corrected image signal 1 1 2 is stored in the memory 3 to be used as another referential image 
106. 

[0047] Fig. 3 Is a block diagram showing an internal configuration of the error macro-block detecting unit (that is. the 
error partial Image region detecting means) 8 indicating features of the first embodiment. In Fig. 3. 21 indicates a lateral 
directional difference calculating unit for receiving the decoded Image signal 110 and a lateral directional block signal 
121 calculating a change degree denoting a difference In pixel level between pixels adjacent to each other through a 
boundary of a to-be-judged block and a block adjacent to the to-be-judged block in a lateral direction, calculating a 
change degree denoting a difference in pixel level between pixels placed in the block adjacent to the to-be-judged 
block in the lateral direction and outputting the change degrees as a lateral directional Inter-pixel difference 123. 
[0048] Also, in Fig. 3, 22 indicates a longitudinal directional difference calculating unit for receiving the decoded 
image signal 110 and a longitudinal directional block signal 122, calculating a change degree denoting a difference in 
pixel level between pixels adjacent to each other through a boundary of the to-be-judged block and a block adjacent 
to the to-be-judged block in a longitudinal direction, calculating a change degree denoting a difference in pixel level 
between pixels placed in the block adjacent to the to-be-judged block in the longitudinal direction and outputting the 
change degrees as a longitudinal directional inter-pixel difference 124. 

[0049] In addition, in Fig. 3, 23 indicates a lateral directional continuity judging unit for receiving the lateral directional 
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inter-pixel difference 123, judging the continuity between the blocks adjacent to each other in the lateral direction and 
outputting a lateral directional continuity 125. 24 indicates a longitudinal directional continuity judging unit for receiving 
the longitudinal directional inter-pixel difference 124, judging the continuity between the blocks adjacent to each other 
in the longitudinal direction and outputting a longitudinal directional continuity 126. 

5 [0050] In addition, in Fig. 3, 25 indicates a block continuity judging unit for receiving the lateral directional continuity 
125 and the longitudinal directional continuity 126, judging the continuity between blocks adjacent to each other and 
outputting an adjacent-block continuity 127.26 indicates an error macro-block judging unit for receiving the adjacent- 
block continuity 1 27. judging according to the adjacent-block continuity 1 27 whether or not the decoded image signal 
110 is an error macro-block and outputting the error macro-block judging result 111 . ..... 

10 [0051] Next, an operation of the en-or macro-block detecting unit 8 will be described. 

[0052] Fig. 4 is a flow chart showing an operation of the error macro-block detecting unit 8. 

[0053] In the error macro-block detecting unit 8, it is judged according to the continuity of an image signal whether 
or not the decoded image signal 110 is an image signal of a macro-block in which an error occurs. The image signal 
has normally a strong correlation between pixels adjacent to each other, and values of pixels existing in one object are 
15 continuously changed. However, in an image signal of a block in which an error occurs, there is high possibility that 
the continuity between blocks adjacent to each other is not maintained. In this embodiment, a macro-block in which 
an error occurs is detected by using the continuity between blocks adjacent to each other. 

[0054] Fig. 5 is a diagram explaining the processing of the lateral directional difference calculating unit 21 and the- 
processing of the longitudinal directional difference calculating unit 22. 

20 [0055] In a step ST1 of Fig. 4, in the lateral directional difference calculating unit 21, a decoded image signal 110 
corresponding to a to-be-judged block (m, n) of Fig. 5 and a lateral directional block signal 121 corresponding to a 
block (m, n-1 ) of Fig. 5 arranged in the lateral direction to the block (m, n) are received, a change degree (or a difference 
value) between levels of each pair of pixels adjacent to each other In the lateral direction is calculated for pixels P^^.n-i 
(i,5) to n-^{iJ) of three columns of the block (m, n-1) placed in the neighborhood of aboundary between the blocks 

25 (m, n) and' On. n-1) and pixels Pm,n('.0) of o"® column of the block (m, n) placed in the neighborhood of the boundary. 
The change degrees are calculated for each of the color difference blocks and the luminance blocks. Thereafter, the 
calculated change degrees are output as the lateral directional inter-pixel difference 123. 

[0056] A change degree (or a difference value) between levels of each pair of pixels adjacent to each other in the 
lateral direction is calculated according to an equation (1). 

30 



35 



(1=0,1 ,-,7, and j=5,6) 

DPm.n(i.O) = Pm.n-l0.7)-Pn..nO.O) 
(i=0.1.-,7) 



(1) 



40 [0057] In a step ST2, in the longitudinal directional difference calculating unit 22, the decoded Image signal 110 
corresponding to the to-be-judged block (m, n) and a longitudinal directional block signal 1 22 corresponding to a block 
(m-1. n) of Fig. 5 arranged in the longitudinal direction to the block (m, n) are received, a difference value between 
levels of each pair of pixels adjacent to each other in the longitudinal direction is calculated for pixels Pm.i.n(S'i) 
p ^ ^(7 J) of three rows of the block (m-1 , n) placed in the neighborhood of a boundary between the blocks (m, n) and 

45 (m-V, n) and pixels P^, ^(Oj) of one row of the block (m, n) placed in the neighborhood of the boundary. The difference 
values are calculated for each of the color difference blocks and the luminance blocks. Thereafter, the difference values 
are output as the longitudinal directional inter-pixel difference 124. 

[0058] In astep ST3 of Fig. 4, in the lateral directional continuity judging unit 23, the existence of a correlation between 
the decoded block (m, n) and the block (m, n-1 ) adjacently placed on the left side of the decoded block (m, n) is judged 

50 according to the change degrees (or the difference values), which is calculated in the lateral directional difference 
calculating unit 21 , in the pixels placed in the neighborhood of the block boundary. In other words, the existence of the 
correlation is judged according to the lateral directional inter-pixel difference 123 expressed by the equation (1), and 
the lateral directional continuity 125 is output. In cases where the correlation with the block (m, n-1) adjacently placed 
on the left side of the decoded block (m. n) does not exist, the group of pixels of the decoded block (m, n) placed in 

55 the neighborhood of the boundary with the block (m, n-1 ) adjacent on the left side has a discontinuity for the group of 
pixels of the block (m, n-1). 

[0059] In cases where the group of pixels of the decoded block (m, n) placed in the neighborhood of the block 
boundary has a discontinuity, a type of change degree (or a type of difference value) in the pixel level from P^ n.., (1,7) 
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to n('.O) 's large as compared with another type of change degree (or another type of difference value) in the pixel 
leverfrom „ 1 (''5) ^^m n-i{i.7). Therefore, the existence of the discontinuity is judged according to these two types 
of change degTees (or the difference values) in the pixel level. Initially, a change degree (or a difference value) APp^.n^i 
(i 7) between a change degree (or a difference value) DPn,,n.-,(i.6) between the adjacent pixels P^, -,(i,5)and P^^^.^ 
(ii6)and a change degree (or a difference value) DP„,n.i(i,7) between the adjacent pixels Pn,,n-i('.6) and P^,n•^^'J) is 
calculated according to an equation (2). 

APm.n-l0.7) = DP^,,.,(i,6) - DP^,^i(i.7) 

(i=0.1,-«.7) (2) 

[0060] In the same manner, a change degree (or a difference value) AP^^^ij.O) between the change degree (or the 
difference value) DP^ n-i0.7) between the adjacent pixels P„,.n.i(i.6) and Pn,.rvi(i.7)and a change degree (or a d.ffer- 
ence value) DP^,n(i,0)' between the adjacent pixels P^,„. i(i,7)and Pn,.n('.0) is calculated according to an equation (3). 

APn,,nO.O) = DPm.n.l(i.7) - DP^,„(i,0) 

(1=0,1 ,-,7) (3) 

[0061] Thereafter, the existence of a discontinuity is judged by judging a change degree (or a difference value) 
between the change degree (or the difference value) AP^,n.i(i.7) calculated in the equation (2) and the change degree 
(or the difference value) AP^^ ^(\,0) calculated In the equation (3) according to a prescribed threshold value TH1 , That 
is, in cases where a following equation (4) is satisfied forthe prescribed threshold value TH1 predetermined. It is judged 
that the pixel Pn,.n('.0) ^^^^^ '"^^ "^^^ *'® discontinued. 

iAPr„.n(i.0)l-lAPm.n-l(i.7)|>TH1 (4) 

[0062] In cases where it is judged that all the pixels placed at the block boundary are discontinued, it is judged that 
the block (m, n) is discontinued with the lateral directional block (m, n-1). 

[0063] In a step ST4 of Fig. 4, in the longitudinal directional continuity judging unit 24, in the same manner as in the 
lateral longitudinal directional continuity judging unit 23, the existence of a correlation between the decoded block (m, 
n) and the block (m-1 , n) placed on the upper side of the decoded block (m, n) is judged according to the change 
degrees (or the difference values), which is calculated in the longitudinal directional difference calculating unit 22. in 
the pixels placed in the neighborhood of the block boundary. In other words, the existence of the correlation is judged 
according to the longitudinal directional inter-pixel difference 124, and the longitudinal directional continuity 126 Is 
output. 

[0064] In a step ST5. in the block continuity judging unit 25. it is judged according to the lateral directional continuity 
125 denoting a judging result of the lateral directional continuity judging unit 23 whether or not the decoded block is 
continuous with the block adjacently arranged on the left side of the decoded block. As a result of the judgment, in 
cases where the decoded block is continuous with the block adjacently arranged on the left side of the decoded block, 
in a step ST8. the block continuity judging unit 25 judges that the decoded block is continuous with the adjacent block. 
[0065] Also, in the step ST5, as a result of the judgment, in cases where the decoded block is not continuous with 
the block adjacently an-anged on the left side of the decoded block, in a step ST6, the block continuity judging unit 25 
judges according to the longitudinal directional continuity 126 denoting a judging result of the longitudinal directional 
continuity judging unit 24 whether or not the decoded block Is continuous with the block adjacently arranged on the 
upper side of the decoded block. As a result of the judgment, in cases where the decoded block is continuous with the 
block adjacently arranged on the upper side of the decoded block, in the step STB, the block continuity judging unit 
25 judges that the decoded block is continuous with the adjacent block. 

[0066] In contrast, in the step ST6. as a result of the judgment. In cases where the decoded block is not continuous 
with the block adjacently arranged on the upper side of the decoded block, in a step ST7. the block continuity judging 
unit 25 judges that the decoded block is discontinuous with all adjacent blocks. As is described above, In cases where 
the decoded block is discontinuous with both the block arranged in the lateral direction and the block arranged in the 
longitudinal direction, the decoded block is judged to be discontinuous with all adjacent blocks. 
[0067] In a step ST9. the judgment of the continuity of the decoded block with the adjacent block is completed for 
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all luminance blocks and alt color difference blocks, the block continuity judging unit 25 outputs the adjacent-block 
continuity 1 27 as a result of the judgment. In a step ST1 0, the error macro-block judging unit 26 judges according to 
the adjacent-block continuity 1 27 whether or not the decoded image signal 1 1 0 denoting a decoded macro-block is an 
error macro-block. 

5 [0068] That is, the error macro-block judging unit 26 judges according to the continuity of each of the color difference 
blocks and the luminance blocks whether or not the decoded macro-block is an error macro-block. For example, In 
cases where the discontinuity is detected In one block selected from among the four luminance blocks and the two 
color difference blocks, the error macro-block judging unit 26 judges that a macro-block including the block relating to 
the discontinuity is a macro-block in which an error occurs. Also, it is applicable that the en-or macro-block judging unit 

10 26 judge according to a combination of the judgments of the continuity in the four luminance blocks and the two color 
difference blocks. 

[0069] In the first embodiment, the error block judgment is performed by using the difference value between levels 
of the adjacent pixels in the lateral direction which are selected from the pixels Pm.n-i0.5) to of three columns 

of the block (m, n-1 ) placed in the neighborhood of a boundary between the blocks (m, n) and (m, n-1) and the pixels. 

15 ^ (i,o of one column of the block (m, n) placed in the neighborhood of the boundary. However, the used pixel columns 

and the number of used pixel columns are not limited in the present invention. Therefore, it is applicable that change 
degrees (or difference values) be examined in a wider range to be used for the error block judgment. Also, in this 
embodiment, in Fig. 5, the change degree (or the difference value) between levels of each pair of pixels adjacent to 
each other is used. However, it is applicable that a change degree (or a difference value) between levels of each pair 

20 of pixels arranged through another pixel be used. Also, these modifications of the first embodiment can be applied for 
the judgment of the continuity between the decoded block (m, n) and the block (m-1 . n) arranged in the longitudinal 
direction. 

[0070] Also, in this embodiment; in the step ST3. the lateral directional continuity judging unit 23 judges the continuity 
in the lateral direction by using the change degree AP^ n.-,(i,7) calculated according to the equation (2) and the change 

25 degree AP^, n(''0) calculated according to the equation (3) and perfomning the comparison with the prescribed threshold 
value TH1 according to the equation (4). However, it is applicable that the continuity in the lateral direction be judged 
by comparing the change degree AP^^n O.O) calculated according to the equation (3) with another prescribed threshold 
value TH1a. This modification can be'applied In the longitudinal directional continuity judging unit 24. 
[0071] As is described above, in the first embodiment, because a macro-block, in which an error occurs, is detected 

30 by using the continuity of the image signal with a block adjacent to the image signal, the error can detected In an early 
stage, the degradation of an image quality caused by the error propagation or the error can be suppressed to the 
minirrium degree, a macro-block, in which an error occurs, can be reliably detected by considering not only the change 
degree between a level of a peripheral pixel of the to-be-judged block and a level of a peripheral pixel of the block 
adjacent to the to-be-judged block but also the change degree between levels of pixels placed in the block adjacent 

.35 to the to-be-judged block. 

EMBODIMENT 2 

[0072] A block diagram showing the configuration of an image decoding apparatus according to a second embodi- 
40 ment of the present invention is the same as that shown in Fig . 2 according to the first embodiment. In this embodiment, 
the threshold value used in the lateral directional continuity judging unit 23 and the longitudinal directional continuity 
judging unit 24 of the error macro-block detecting unit 8 in the first embodiment is adaptively changed according to a 
quantization step size of each macro-block. 

[0073] * As is described in the first embodiment, in cases where the quantization is performed for each block after an 
45 orthogonal transformation such as DCT is performed for each block, a noise, which is peculiar to the orthogonal trans- 
formation coding and is called a block distortion, occurs. Because of this block distortion, there is a case that a change 
degree between levels of pixels placed in the neighborhood of the block boundary becomes large. Therefore, in the 
error macro-block detecting unit 8 according to the second embodiment, a threshold value control unit, in which the 
threshold value is adaptively controlled, is arranged by considering the influence of the block distortion. 
50 [0074] Fig. 6 is a block diagram showing an internal configuration of the error macro-block detecting unit (that is, the 
error partial image region detecting means) 8 according to the second embodiment. In Fig. 6. 27 indicates a threshold 
value control unit for controlling a threshold value 128 according to a quantization step size of a macro-block. The 
quantization step size is included in the additional information 104 decoded in the variable-length decoding unit 1 
shown in Fig. 2. The operations of the lateral directional difference calculating unit 21 , the lateral directional continuity 
55 judging unit 23, the longitudinal directional difference calculating unit 22, the longitudinal directional continuity judging 
unit 24, the block continuity judging unit 25 and the error macro-block judging unit 26 are the same as those in the first 
embodiment. 

[0075] Next, an operation is described. 
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[0076] Fig 7 is a flow chart showing an operation of the threshold value control unit 27 according to the second 
embodiment The threshold value control unit 27 controls a threshold value 128 according to a quantization step size 
of a macro-block included in the additional information 1 04. In a step ST1 1 , the threshold value control unit 27 confirms 
whether or not the quantization step size of a macro-block included in the additional information 104 is larger than a 
prescribed value Q1 In cases where the quantization step size is larger than the prescribed value Q1 . because there 
is a case that a change degree (or a difference value) between levels of pixels placed in the neighborhood of the block 
boundary becomes large because of a block distortion, in a step ST12. the threshold value used for the judgment of 
the continuity is set to a high value THa In the threshold value control unit 27 according to the quantization step size 
larger than the prescribed value Q1. .. ^ ^ i 

[00771 In contrast, in the step ST1 1 , in cases where the quantization step size is smaller than the prescribed value 
Q1 in a step ST1 3, the threshold value control unit 27 confirms whether or not the quantization step size is larger than 
a prescribed value'Q2 (Q2<Q1). In cases where the quantization step size is larger than the prescribed value Q2. in 
a step ST1 4, the threshold value used for the judgment of the continuity is set to a value THb lower than the value THa 
in the threshold value control unit 27 according to the quantization step size. 

[0078] In the same manner, the processing in a step ST1 5. a step ST1 6 and a step ST1 7 is perfomied, in cases 
where the quantization step size is larger than the prescribed value Q3 {Q3 < Q2 < Q1), the threshold value is set to 
a value THc In cases where the quantization step size is smaller than the prescribed value Q3. because the influence 
of the block distortion is low, the threshold value is set to a value THd (THd < THc < THb < THa) according to the 
quantization step size smaller than the prescribed value Q3. 

[0079] In the processing of Fig. 7, a range of the quantization step size is divided at four ranks, and the threshold 
value is set according to each value of the quantization step size. However, the present invention is not limited to the 
four ranks and the threshold value can be adaptively set according to quantization characteristics. 
[0080] Iri Fig 6, the threshold value 128 set by the threshold value control unit 27 is output to the lateral directional 
continuity judging unit 23 and the longitudinal directional continuity judging unit 24 and is used as a threshold value 
for the judgment of the continuity with the lateral directional block signal 121 and the judgment of the continuity with 
the longitudinal directional block signal 122 in the same manner as in the first embodiment. 

[0081 ] As is described above, in the second embodiment, because the threshold value used for the judgment of the 
continuity with the adjacent block Is controlled according to the quantization step size, the discontinuity at the block 
boundary caused by the block distortion can be distinguished from the discontinuity at the block boundary caused by 
the error, so that it can avoid to erroneously judge a macro-block, in which a block distortion occurs, to be a macro- 
block in which an error occurs. 



EMBODIMENTS 



[0082] A block diagram showing the configuration of an image decoding apparatus according to a third embodiment 
of the present invention is the same as that shown in Fig. 2 according to the first embodiment. In the first embodiment, 
the discontinuity between blocks is judged according to the inter-pixel difference value between pixels placed in the 
neighborhood of the block boundary, and the detection of an error macro-block is performed. However, in the third 
embodiment, an error macro-block is detected according to a representative value of pixel levels calculated for each 
block. 

[0083] Fig 8 is a block diagram showing an internal configuration of the error macro-block detecting unit (that is. the 
error partial image region detecting means) 8 according to the third embodiment. In Fig. 8. 31 indicates an inner-block 
pixel average value calculating unit for receiving the decoded image signal 110, calculating an inner-block pixel average 
value as a representative value of pixel levels of one decoded block (or one to-be-judged block) for each decoded 
block and outputting the inner-block pixel average values as a plurality of pixel level average values 131 . 32 indicates 
a pixel average difference calculating unit for receiving the pixel level average value 131 of each decoded block, re- 
ceiving a neighboring block pixel level average value 132 denoting a representative value of pixel levels of one neigh- 
boring block stored in a prescribed memory for each neighboring block placed in the neighborhood of the decoded 
block calculating a difference between one pixel level average value 131 and the neighboring block pixel level average 
value 1 32 of each neighboring block for each decoded block and outputting each difference as a pixel average difference 
133. 33 indicates an error macro-block judging unit for receiving the pixel average differences 133, judging to be or 
not to be an error macro-block and outputting an error macro-block judging result 111 . 
[0084] Next, an operation will be described. 

[0085] Fig. 9 is a flow chart showing an operation of the error macro-block detecting unit 8 according to the third 
embodiment The following processing is performed in the error macro-block detecting unit 8 for each of the color 
difference blocks and the luminance blocks of the decoded image signal 11 0. In a step ST21 , the decoded image signal 
1 1 0 is received in the inner-block pixel average value calculating unit 31 , and an average value of pixel values in one 
decoded block (m,n) is calculated according to an equation (5) for each decoded block. 
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AVePm,n = 2 Pm,n(i, j)/64 
ir j - 0 

to an equation (6). 
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[io88] 'n the error macro-b|ock judging un,t 33^^^^^^ ,33 ,,,, „,,g,boring block 

existence of an error macro-block .s J"«^9^,'=y "^"^ 3^'''^,^ an error macro-block judging result 111 is output, 
calculated in the pixel average difference calc"1^.ng unrt 32 and an err^r ^ jj^^^ ^^^^^^^^ ^^^^ ^ ^.^^^ 

10089] AS an error '--'^^--^^^^'^^^^^^^^^^ unit 33. for example, according to an 
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[0096] As is described above, in the third embodiment, the representative value is calculated for each decoded image 
block the representative value of the decoded image block is compared with the representative value of each neigh- 
boring block for each decoded image block, and a macro-block, in which an error occurs, is detected. Therefore 
because a macro-block, in which an error occurs, can be detected, the error can be detected in an early stage, and 
an error propagation or the degradation of an image quality caused by the error can be suppressed to the minimum 
degree. 

EMBODIMENT 4 

r00971 A block diagram showing the configuration of an image decoding apparatus according to a third embodiment 
of the present invention Is the same as that shown in Fig. 2 according to the first embodiment. In this embodiment, the 
threshold value which is used in the error macro-block judging unit 33 of the error macro-block detecting unit 8 de- 
scribed in the third embodiment, is adaptively controlled according to the quantization step size of each macro-block. 
rO0981 As is described in the first embodiment, in cases where the quantization is performed for each block after an 
orthogonal transformation such as DCT is performed for each block, when the quantization step size is large, an am- 
plitude of the image signal is smoothed, so that the amplitude is made small. Therefore, in cases where the quantization 
step size is large, there is a case that the pixel average value of each block is made small. Therefore, m the error 
macro-block detecting unit 8 according to this embodiment, a threshold value control unit, in which the threshold value 
is controlled, is an-angsd by considering the influence of the quantization step size. • . • ■. • 

r00991 Fig 11 is a block diagram showing an internal configuration of the error macro-block detecting unit (that is. 
the error partial image region detecting means) 8 according to the fourth embodiment of the present invention. In Fig. 
1 1 34 indicates a threshold value control unit for setting a threshold value 134 according to a quantization step size 
of each macro-block. The quantization step size is included in the additional infomfiation 104 decoded in the variable- 
length decoding unit 1 shown in Fig. 2. The operations of the inner-block pixel average value cateulating unit 31. the 
pixel average difference calculating unit 32 and the error macro-block judging unit 33 are the same as those in the 
third embodiment. 

rolOOl Next, an operation is described. . 
r01011 The threshold value control unit 34 controls a threshold value 134 according to a quantization step size of 
each macro-block included in the additional infomiation 104. For example, in cases where the quantization step size 
is large because an amplitude of the image signal is made small, there is a case that the pixel average value of each 
block is made small. Therefore, the threshold value 134 Is set to a low value. Also, in cases where the quantization 
step size is small, because the amplitude of the image signal is maintained, the pixel average value of each block is 
not made small. Therefore, the threshold value 1 34 is set to a high value. , , . ^ . 

[0102] The threshold value 1 34 set in the threshold value control unit 34 is output to the error macro-block judging 
unit 33, and the threshold value 1 34 is used to judge the corresponding macro-block to be or not to be an error macro- 

[01 03] As is described above, in the fourth embodiment, because the threshold value used for the judgment to be 
or not to be an error macro-block is controlled according to the quantization step size, an erroneous judgment for the 
macro-block, in which an enror occurs, can be avoided. 

EMBODIMENTS 

[01 04] A block diagram showing the configuration of an image decoding apparatus according to a third embodiment 
of the present invention is the same as that shown in Fig. 2 according to the first embodiment. In this embodiment the 
judgment to be or not to be an error macro-block is perfomned by combining the error macro-block judging methods 
described in the first to fourth embodiments. . 
[0105] Fig 1 2 is a block diagram showing an internal configuration of the error macro-block detecting unit (that is. 
the error partial image region detecting means) 8 according to a fifth embodiment. In Fig. 12. 41 indicates a threshold 
value control unit for setting a prescribed threshold value 141 and a prescribed threshold value 142 according to a 
quantization step size of each macro-block. The quantization step size is included in the additional infonmation 104 
decoded in the variable-length decoding unit 1 shown in Fig. 2. 42 indicates an error macro-block judging unit for 
judging each coded macro-block to be or not to be an error macro-block according to the adjacent-block continuity 1 27 
and the pixel average difference 133. 

[01 06] In Fig 1 2 the lateral directional difference calculating unit 21 , the longitudinal directional difference calculating 
unit 22 the lateral directional continuity judging unit 23, the longitudinal directional continuity judging unit 24. the block 
continiirty judging unit 25, the inner-block pixel average value calculating unit 31 and the pixel average difference 
calculating unit 32 are the same as those in the first and third embodiments. 
[0107] Next, an operation will be described. 
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[01081 An operation of the threshold value control unit 41 is the sanne as that in the second and fourth ennbodiments. 
Fig 1 3 Is a flow chart showing an operation of the error macro-block detecting unit 42 according to the fifth embodiment. 
[0109] In the en-or macro-block detecting unit 42, each decoded macro-block is judged to be or not to be an error 
macro-block according to the adjacent-block continuity 127 and the pixel average difference 133. In a step ST31 , the 
continuity of one decoded block with each of adjacent blocks adjacent to the decoded block is judged in the error 
macro-block detecting unit 42 according to the adjacent-block continuity 127. This continuity judgment is perlormed 
for the color difference blocks and the luminance blocks in that order. 

[01 10] As a result of the judgment in the step ST31 . in cases where the decoded block is continuous with one adjacent 
block in a step ST35, it is examined in the error macro-block detecting unit 42 whether or not the error judgment is 
perfomied for all decoded blocks. In cases where the en-or judgment is not perfomned for all decoded blocks, the 
procedure returns to the step ST31 , and the continuity of another decoded block with each adjacent block is examined. 
[0111] In contrast, as a result of the judgment in the step ST31 , in cases where the decoded block Is discontinuous 
with all adjacent blocks, In a step ST32. as Is described in the third embodiment, the error macro-block detecting unit 
42 judges the decoded block to be or not to be an error block according to the pixel average difference 133. 
[01 121 In a step ST33, in cases where it is judged that the decoded block is to be an error block, in a step ST34, the 
error macro-block detecting unit 42 judges one macro-block including the decoded block to be an error macro-block 
and outputs an error macro-block judging result 111 to the change-over unit 9 shown in Fig. 2. 
[01 13] In contrast, in the step ST33, in cases where it is judged that the decoded block is not to be an error block, 
in the step ST35 this judgment of the step ST33 is perfonned for all decoded blocks of the corresponding macro-block. 
In cases where it is judged in the steps ST33 and ST35 that each of all the decoded blocks is not to be an error block, 
in a step ST36. the error macro-block detecting unit 42 judges the macro-block including the decoded blocks to be a 
normal macro-block and outputs an error macro-block judging result 111 to the change-over unit 9. 
[0114] That is. in cases where it is judged In the step ST31 that each of all decoded blocks included in the corre- 
sponding macro-block is continuous with one adjacent block or in cases where it is judged, in the step ST33. according 
to the pixel average difference that each of the decoded blocks is not an error block, the macro-block including the 
decoded blocks is judged, in the step ST36 .to be a nonnal macro-block. However, it Is applicable that one macro- 
block be judged in the step ST36 to be a nonmal macro-block in cases where it is judged in the step ST31 that each 
of all decoded blocks of the macro-block is continuous with one adjacent block and in cases where it Is judged, m the 
step ST33. according to the pixel average difference that each of all decoded blocks of the macro-block is not an error 

[0115] In this embodiment, the threshold value control unit 41 controls the prescribed threshold value 1 41 and the 
prescribed threshold value 1 42 according to the quantization step size of each macro-block. However, it is applicable 
that no control according to the quantization step size is performed for the prescribed threshold value in the same 

manner as in the first and third embodiments. 

[0116] As is described above, in the fifth embodiment, because the macro-block Is judged to be or not to be an error 
macro-block according to the plurality of judging methods, the macro-block, in which an error occurs, can be more 
reliably judged to be an error macro-block, so that an erroneous judgment can be avoided. 

[01 1 7] Also the judgement is hierarchically performed from the judging processing for the color difference blocks to 
the judging processing for the luminance blocks, in cases where one decoded block is judged to be an error block, the 
macro-block including the decoded block is judged to be an error macro-block, and the judging processing for the 
remaining decoded blocks is not performed. Therefore, a calculation volume required for the judging processing can 
be reduced. 

EMBODIMENJT 6 

[01 18] In the first to fifth embodiments, the image decoding apparatus operated for the image decoded according to 
the coding method of the MPEG-4 in the moving picture is described. However, the image decoding apparatus of the 
present invention can be applicable for a still picture. Also, the coding method, in which the OCT and the quantization 
are performed for each block, is described. However, the Image decoding apparatus of the present invention is not 
limited to the coding method. That is, the image decoding apparatus of the present invention is applicable for all coding 
methods in which the coding such as an orthogonal-transfomiation other than DCT is performed for each block. 
[01 19] In addition the continuity of one block with each neighboring block is examined for each block composed of 
8-8 pixels However, the present invention is not limited to this block unit of the 8*8 pixel size. For example, it is 
applicable that the continuity of one macro-block with each neighboring macro-block be examined for each macro- 
block composed of 16*16 pixels. . u • 
[0120] In addition, the present invention is not limited to the block or macro-block having a fixed shape, in cases 
where an Image is coded for each region having an arbitrary shape, the continuity of one region with each neighboring 
region is examined for each region. Therefore, the present invention is applicable for all coding methods in which the 
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coding is performed for each region having -an arbitrary shape. 
EMBODII^ENT 7 

r01 21 1 A block diagram showing the configuration of an image decoding apparatus according to a third emlDodiment 
LTthe present inSn is the same as that shown in Fig. 2 according to the first embodiment. In the first to s.xth 
!mhnHS^ents he r^acro-block in which a bit error occurs, is detected by using the continuity of the image signal .n a 
:p"a^a?dTecit;rtnrs em^^dlent. a macro-block, in which a bit error occurs, is detected by using the corre.at.on of 



SlS^'tnl^tragVro^intt causes where a motion of the image is slow, an inter-frame prediction coding, in wh^h 
[hi ™ i^n Lxistina between frames is used, is perfomied. In a motion compensating prediction known as a rep- 
eLXS "rime pSon coding method, each frame is divided into a plurality of blocks respectively having a 
redetermined mage size, a block, in which a d^erence signal becomes the smallest in a P^^f ^-"^'"f^/^a^;; '^^ 
r«^nH nuT mm Toast frame a shift from a position of the found-out block to a position of a to-be-coded block is set 
Ls fmolrerr^is m^^^^^^^^ vector and the difference signal (that is, a prediction error signal) are coded and are 

roSr"^"afe: reSalS^milar to the to-be-coded block exists in the past frame, because a variance of the 
Sior^ errsigna, is made small, the to-be-coded block can be efficiently coded. In "^^^^^ 
bSSmlter to the to-be-coded block does not exist in the past frame, because a variance of the prediction error signal 
madL large L coding of the to-be-coded block is perlormed by using only infomnaton of a current frame (mtra- 
L^^n^ on a'sWe of the decoding apparatus, as is described in the first embodiment, the motion vector 103 and the 
oSl°error sTgnln 09 d^^^^^ from the coded bit stream 1 01 are decoded, the predicted image 1 07 is taken 

SccordfnTto the d'^^^^^^^^ motiSn vector 103. and the predicted image 107 is added to the decoded prediction error 
cinnal 109 to reoroduce the decoded image signal 110. . i. 

rSzV in S^S^^^^^^ because the intra-coding is selected on a side of the coding apparatus in cases whe « 

a variance of the decoded prediction error signal 1 09 becomes large, the selection of the intra-coding .s utilized in this 
:mbod^enT^hat is, a threshold value processing is perfomied for a variance of the decoded prediction error signal 
1 09 on the decoding apparatus side, so that a macro-block, in which a bit error occurs, .s detected. 

0125? Fig uta block diagram showing an internal configuration of the error macro-block detecting unit (that is 
thl eior parti^ image region detecting means) 8 according to the seventh embodiment. In F.g 14. 51 indica es a 
predicted error signal varLce calculating unit for calculating a variance of the decoded prediction error signal 1 09 
and ou^utting a prediction error signal variance 151 . 52 indicates a decoded image signal ^^^^^ 
for calculating a variance of the decoded image signal 110 and outputting a decoded .mage signal vanance 152. 53 

ndtoafes an e^^ macro-block judging unit for judging each macro-block to be or not to be an error macro-block ac- 
SlSg to theTe jTcfen error signal variance 1 51 and the decoded image signal variance 1 52 and outputting an error 
macro-block judging result 111. 

£lSinn unit 8 in this embodiment is not applied for an intra-macro-block but is applied only for an inter-macro-block. 
foS ^irasLpS^4l TttS 

Ln it ? of Rg Jwhewi each macro-block is an inter-macro-block or an intra-macro-block In case of the intra-macro^ 
block one of the judging methods in the first to fifth embodiments can be used. In case of the inter-macro-block, the 
judgment to be or not to be an error macro-block is performed according to a following Procedure. ^ .. „ 

roSr In a step ST42 in the predicted error signal variance calculating unit 51 , a vanance of the decoded prediction 
Lr or ignal lS iscalculated according to an equation (10). and a prediction error signal variance 151 is ou put. Here 

P denLs a prediction error signal variance. P, denotes a value of a pixel placed at a row -n^ a^^^^ i 
predicted error block having an N'N pixel size, and mp denotes an average of pixel values of the predicted error block 
having the N*N pixel size. 



a^P) = (l/N^)2(Pi,3 - mp)', mp = {1/N') S Pi,j (10) 



[01301 In a step ST43. in the decoded image signal variance calculating unit 52. a vanance of the decoded image 
siqna 110 is calculated according to an equation (11). and a decoded image signal vanance 152 ,s output. Here, 
S denotes a decoded Image signal variance, d^j denotes a value of a pixel placed at a row i and a column j of a 
SLded block having an N'N pixel size, and m, d'enotes an average of pixel values of the decoded block having the 
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N*N pixel size. 



"... 
a^{D) = (l/N')2(di,J - nva)', m = {1/N')S di,j — (11) 

r0131l In a step ST44. in the error macro-block judging unit 53, a comparison Is performed according to an equation 
12) bv using the prediction error signal variance 151 calculated in the predicted error signal variance calculating unit 
51 /the decoded image signal variance 1 52 calculated In the decoded image signal variance calculating unit 52and a 
prescribed threshold value TH3. 

o^(P) > (D) + TH3 02) 

r01321 In the step ST44, in cases where the prediction error signal variance (P) is larger than a sum of the decoded 
image signal variance (D) and the prescribed threshold value TH3. in a step ST45. the error macro-block judging . 
unit 53 judges the macro-block to be an en-or macro-block: ■ r ., 

r0133l In contrast In the step ST44, in cases where the prediction eaor signal variance o2 (P) is not larger than a - 
sum of the decoded image signal variance (D) and the prescribed threshold value TH3, In a step ST46. the error - 
macro-block judging unit 53 judges the macro-block to be a nomnal macro-block. . , . ^ ,r., 

r0134l In this embodiment, the prediction error signal variance (P) and the decoded image signal variance cr2 D) 
are used as representative values of the decoded prediction error signal 109 and the decoded image signal 110. 
However it is applicable that an average or a sum of squares be used as a representative value. Also the judgment 
to be or not to be an error macro-block can be perfomied by combining the method described In this embodiment and 
one of the methods described In the first to fifth embodiments. ^ ,. ^ ^ ^ 

r01351 As is described above, in the seventh embodiment, the prediction error signal variance 1 51 and the decoded 
image signal variance 1 52 are compared with each other, so that the detection of an error macro-block can be performed 
by using the correlation of the image signal in the time direction. Therefore, an error can be detected In an eariy stage, 
and an error propagation or the degradation of an Image quality caused by the error can be suppressed to the minimum 
degree. 

EMBODIMENT 8 

[01361 In an eighth embodiment of the present Invention, a coded bit stream is received from a transmission line or 
a recording medium, the decoding and display of an Image are performed in an image decoding apparatus, an occur- 
rence frequency of a bit error is detected, in cases where it is judged that the occurrence frequency Is high, an operation 
of the error macro-block detecting unit is started. Therefore, an erroneous operation of the error macro-block detecting 
unit is reduced, and the degradation of an image quality caused by a decoded error is stably suppressed. 
r01 371 In the above-described error macro-block detecting unit, because an error is assumed and detected according 
to stationary properties of an image signal before the decoding of the image signal becomes impossible in process of 
a syntax analysis or before a fatal error for image data such as the decoding of unrighteous data is detected, there is 
a possibility that an erroneous detection is performed. Therefore, in this embodiment, only In case of the receiving 
conditions In which the bit error frequently occurs, an operation of the error macro-block detecting unit is started, the 
tolerance to the en-or is heightened, so that a decoding operation stable as a whole is perfomied. 
roi 38] Fig 1 6 is a block diagram showing the configuration of an image decoding apparatus according to an eighth 
embodiment In Fig 16,61 indicates an error supeivising unit for receiving a string of media packets 201 andoutputting 
a bit error count value 202. 62 indicates an error detecting operation start control unit for receiving the bit error count 
value 202 and outputting an en-or detection start instruction flag 203 to control an operation start of the error macro- 
block detecting unit 8. 63 Indicates a change-over unit for transmitting the decoded image signal 110 received from 
the adding unit 7 to the error macro-block detecting unit 8 according to the error detection start Instruction flag 203. 71 
Indicates a supervising means composed of the error supen/ising unit 61 and the en-or detecting operation start control 
unit 62 The other configuration is equivalent to that of Fig. 2 according to the first embodiment. 
[0139] Fig 1 7 is a diagram showing the configuration of the string of media packets 201 . The media packet is defined 
as a digital data unit, in the media packet, video data, audio data which is planned to be decoded and presented in 
synchronization with the video data and various media such as text, graphics and still pictures are packed at a format 
which Is standardized according to prescribed rules. For example. MPEG-2 (ISO/I EC 1381 8-1) packetized elementary 
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stream (PES) ITU-T H.223 AL-PDU or the like are known as the media packet. 

r0140l In Fiq 17 a packet header of each media packet denotes various pieces of header infomnation describing a 
packet attribute, a media type and the like, a piece of media data of each media packet denotes peculiar coded data 
such as video data, audio data or the like, and an error detecting code added to of each media packet denotes an 
added bit used to perform an error detection such as a cyclic redundancy check (CRC) orthe like. The string of media 
packets 201 fomned at a standardized media packet type shown in Fig. 1 7 is transmitted, and on^ the image coded 
data (that is. the coded bit stream 101) included in the string of media packets 201 is fed to the variable-length decoding 

ro?4irreTan operation is described. The operations performed in the partial image region data decoding means 
1 1 the error macro-block detecting unit 8 and the units following the error macro-block detecting unit 8 are the sarrie 
as'those perfomied according to the first embodiment. In the error supervising unit 61 . the stnng of media packets 201 
is received a bit error occurrence frequency is supervised by using the error detecting code attached to each piece of 
media data, the number of detected bit errors is counted, and a bit error count value 202 .s output, 
roi 421 In the error detecting operation start control unit 62. the bit error count value 202 denoting an error detecting 
result obtained in the error supen^ising unit 61 is checked at prescribed unit-time intervals. In cases where the bit error 
count value 202 checked at the prescribed unit-time intervals exceeds a prescribed threshold value, it is judged that 
the receiving conditions deteriorate (for example, a bit error rate in the transmission line is large the read.ng-out from 
a recording medium is unstable, or the like), so that an en-or detection start Instruction flag 203 is output. 1" contrast 
in cases where the bit error count value 202 at the prescribed unit-time intervals does not exceed a prescnbed threshold 
value it is judged that the receiving conditions are good, so that no error detection start instruction flag 203 is output. 
r01 431 In the change-over unit 63. in cases where the error detection start instruction flag 203 is received from the 
error detecting operation start control unit 62. the decoded image signal 110 received from the adding unit 7 is input 
to the error macro-block detecting unit 8 to make the error macro-block detecting unit 8 start an operation. In contrast 
in cases where no error detection start instruction flag 203 is received from the error detecting operation start control 
unit 62. the change-over unit 63 does not make the error macro-block detecting unit 8 start an operation, but the 
decoded image signal 110 received from the adding unit 7 is output. , ^ . 

r01 44] In the error macro-block detecting unit 8. a macro-block, in which an error occurs, is detected in tine configu- 
ration according to the one of the first to seventh embodiments, and a correcting processing is performed for a lost 
image region in the error macro-block con-ecting unit 10. . , u-» w«,«^nr,^ 

r01451 Fig 18 is a block diagram showing the configuration of the error supen/ising unit 61. In a bit error detecting 
unit 81 the string of media packets 201 is received, one or more bit errors occurring in each media packet are detected 
by using the error detecting code added to the string of media packets 201 for each packet, and a bit error count value 
21 1 is output for each packet. In a bit error counter 82. the bit error count value 21 1 received from the bit error detecting 
unit 81 for each packet is summed up for each media packet, and a summed-up bit error count value 202 is output to 
the error detecting operation start control unit 62 for each media packet. As is described above, in the error supervising 
unit 61 the change of each summed-up bit error count value 202 is supervised, so that the bit error occurrence fre- 
quency" in the string of media packets 201 . which is in the middle of the transmission through the transmission line, or 
the bit error occurrence frequency in the string of media packets 201 , which is in the middle of the readmg-out from a 

recording medium, is supervised. j 

[0146] As one supervising method performed in the error supervising unit 61 , the present invention is no limrted o 
the method based on the error detecting code described above, and it is applicable that a received electnc field strength 
of a radio wave carrying a string of media packets or phase infomnation obtained after a delay-detection of the radio 
wave be supervised. Also, it is applicable that a bit error state in other media packets such as audio data be supervised 
to supervise the bit error occurrence frequency by additionally considering a supervised result of the bit error state. 
[0147] The control in the error detecting operation start control unit 62 is not limited to an on-off control described 
above various control methods are applicable. For example, though the threshold value is controlled according to the 
quantization step size of the macro-block included in the additional infomnation 1 04 in the first and fourth embodiments 
it is applicable that the threshold value be controlled according to each summed-up bit error count value 202 received 
from the error supervising unit 61. j » 

[01481 That is in cases where the summed-up bit error count value 202 is high, the receiving conditions detenorate 
to heighten a probability that an error occurs. Therefore, the threshold value is set to a low value. In contrast, iri cases 
where the summed-up bit error count value 202 Is low, the receiving conditions are stable to lower a probability tha 
an error occurs. Therefore, the threshold value is set to a high value. Therefore, because the threshold value is set 
according to the output result of the error supervising unit 61 , the processing of the error macro-block detecting unit 8 
is controlled, in cases where the receiving conditions are good, the erroneous detection in the error macro-block de- 

tectinq unit 8 can be avoided. . 

[01 49] As another control method performed in the error detecting operation start control unit 62, an estimation range 
of the continuity can be changed. In the first embodiment, the judgment of the continuity is performed for each of the 
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color difference blocks and the luminance blocks respectively having the 8*8 pixel size, in cases where the judgment 
of the discontinuity is performed for at least one block included In one macro-block, it is judged that the macro-block 
including the block is an error macro-block. However, in cases where it is judged according to the output result of the 
error supervising unit 61 that the receiving conditions are stable, because the probability that an error occurs is low, 
5 to make strict the detecting condition of the error macro-block, in case of the luminance blocks, it is applicable that the 
judgment of the discontinuity is performed for each macro-block of 1 6*1 6 pixel size. Also, it is applicable that the number 
of to-be-estimated pixels for the inter-pixel difference be increased. 

[0150] As is described above, in the eighth embodiment, because the error macro-block detecting unit 8 is adaptively: 
operated according to the reliability of the transmission quality of the transmission line or the reliability of the reading- 
10 out from the recording medium, in cases where the receiving conditions are good, the erroneous detection perfomned 
in the error macro-block detecting unit 8 can be avoided, and a decoding operation stable as a whole can be performed. 
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Claims 



1 . An image decoding apparatus, in which a coded bit stream produced by compressing and coding an input -image 
signal for each partial image region is decoded, comprising: ^ . 

partial image region data decoding means for decoding the coded bit stream for each partial image region; and 
20 error partial image region detecting means for calculating a first pixel level change degree between pixels 

adjacent to each other through a boundary between a decoded partial image region decoded by the partial 
image region data decoding means and a partial image region adjacent to the decoded partial image region, 
calculating a second pixel level change degree between pixels of the partial image region adjacent to the 
decoded partial image region, and detecting according to the first pixel level change degree, the second pixel 
25 level change degree and a prescribed threshold value relating to the first pixel level change degree and the 

second pixel level change degree that the decoded partial image region is an error partial image region in 
which an influence of a bit error occurring in the coded bit stream is received. 

2. An image decoding apparatus according to claim 1 . wherein the error partial image region detecting means cal- 
30 culates a first pixel level difference value between pixels adjacent to each other through the boundary between 

the decoded partial image region and the partial image region adjacent to the decoded partial image region, cal- 
culates a second pixel level difference value between pixels of the partial image region adjacent to the decoded 
partial image region, calculates a third pixel level difference value between pixels of the partial image region ad- 
jacent to the decoded partial image region, and detects according to a difference value between the first pixel level 
35 difference value and the second pixel level difference value, a difference value between the second pixel level 

difference value and the third pixel level difference value and the prescribed threshold value that the decoded 
partial image region is the en-or partial image region in which the influence of the bit error occurring in the coded 
bit stream is received. 

40 3. An image decoding apparatus according to claim 1 , wherein the error partial image region detecting means com- 
prises threshold value control means for controlling the prescribed threshold value used for the detection of the 
error partial image region according to a quantization step size decoded from the coded bit stream. 

4, An image decoding apparatus, in which a coded bit stream produced by compressing and coding an input image 
45 signal for each partial image region is decoded, comprising: 

partial image region data decoding means for decoding the coded bit stream for each partial image region; and 
error partial image region detecting means for calculating a representative value of a plurality of first pixel 
levels in a decoded partial image region decoded by the partial image region data decoding means, calculating 

50 a representative value of a plurality of second pixel levels in a partial image region placed in the neighborhood 

of the decoded partial image region, and detecting according to the representative value of the first pixel levels, 
the representative value of the second pixel levels and a prescribed threshold value relating to the represent- 
ative value of the first pixel levels and the representative, value of the second pixel levels that the decoded 
partial image region is an error partial image region in which an influence of a bit error occurring in the coded 

55 bit stream is received. 

5. An image decoding apparatus according to claim 4, wherein the error partial image region detecting means cal- 
culates an average of the first pixel levels as the representative value of the first pixel levels, calculates a plurality 
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of averages of a plurality of groups of second pixel levels as a plurality of representative values of the plurality of 
groups of second pixel levels in a plurality of partial image regions placed in the neighborhood of the decoded 
partial image region, and detects the error partial image region according to a difference between the average of 
the first pixel levels and the average of each .group of second pixel levels and a prescribed threshold value relating 
to the differences. 

6 An image decoding apparatus according to claim 5. wherein the error partial image region detecting means weights 
the difference between the average of the first pixel levels and the average of each group of second pixel levels 
according to a correlation between the decoded partial image region and the corresponding partial image region 
placed in the neighborhood of the decoded partial image region. • 

7 An image decoding apparatus according to claim 4. wherein the error partial image region detecting means com- 
prises threshold value control means for controlling the prescribed threshold value used for the detection of the 
error partial image region according to a quantization step size decoded from the coded bit stream. 

8. An image decoding apparatus, in which a coded bit stream produced by compressing and coding an input image 
signal for each partial image region is decoded, comprising: 

partial image region data decoding means for decoding the coded bit stream for each partial image region; and 
error partial image region detecting means for calculating a first pixel level change degree between pixels 
adjacent to each other through a boundary between a decoded partial image region decoded by the partial 
image region data decoding means and a partial image region adjacent to the decoded partial image region, 
calculating a second pixel level change degree between pixels of the partial image region adjacent to the 
decoded partial image region, judging continuity between the decoded partial image region and the partial 
image region adjacent to the decoded partial image region according to the first pixel level change degree, 
the second pixel level change degree and a first prescribed threshold value relating to the first pixel level 
change degree and the second pixel level change degree, calculating a representative value of a plurality of 
first pixel levels in the decoded partial image region, calculating a representative value of a plurality of second 
pixel levels in the partial image region placed in the neighborhood of the decoded partial image region, and 
detecting according to the judgment of the continuity between the decoded partial image region and the partial 
Image region adjacent to the decoded partial image region, the representative value of the first pixel levels, 
the representative value of the second pixel levels and a second prescribed threshold value relating to the 
representative value of the first pixel levels and the representative value of the second pixel levels that the 
decoded partial image region is an error partial image region in which an influence of a bit error occurring in 
the coded bit stream is received. 

9 An image decoding apparatus according to claim 8, wherein the error partial image region detecting means com- 
prises threshold value control means for controlling the first prescribed threshold value and the second prescribed 
threshold value used forthe detection of the error partial image region according to a quantization step size decoded 
from the coded bit stream. 

10. An image decoding apparatus, in which a coded bit stream produced by compressing and coding an input image 
signal for each partial image region is decoded, comprising: 

partial image region data decoding means for decoding the coded bit stream for each partial image region; and 
error partial image region detecting means for detecting according to a comparison between a decoded image 
signal decoded by the partial image region data decoding means and a predicted error signal that the decoded 
partial image region is an error partial image region in which an influence of a bit error occurring in the coded 
bit stream is received. 

11 An image decoding apparatus according to claim 10, wherein the error partial Image region detecting means cal- 
culates a representative value of the decoded image signal and a representative value of the predicted error signal 
and detects according to the representative value of the decoded image signal, the representative value of the 
predicted error signal and a prescribed threshold value relating to the representative value of the decoded image 
signal and the representative value of the predicted error signal that the decoded partial image region is the error 
partial image region. 

12. An image decoding apparatus, in which a media packet string including a coded bit stream produced by compress- 
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ing and coding an input image signal for each partial image region is received and the coded bit stream is decoded, 
comprising: 

partial image region data decoding means for decoding the coded bit stream for each partial image region; 
error partial image region detecting means for detecting according to a comparison between an Image signal 
characteristic at a decoded partial image region decoded by the partial image region data decoding means 
and an image signal characteristic at one.partial Image region placed in the neighborhood of the decoded 
partial image region that the decoded partial image region is an error partial image region in which an Influence 
of a bit error occurring in the coded bit stream Is received, for each partial image region; and 
supervising means for supervising a bit error occurrence frequency in the reception of the media packet string 
according to an error detecting code included in the media packet string, wherein the error partial Image region 
detecting means is controlled according to a supervising result of the supervising means. 

13. An image decoding apparatus according to claim 12, wherein the error partial image region detecting means con- 
trols, according to the supervising result of the supervising means, a comparison condition used in the comparison 
between the image signal characteristic at the decoded partial image region and the image signal characteristic 
at the partial image region placed in the neighborhood of the decoded partial image region. 

14. An image decoding apparatus according to claim 1 2, wherein the error partial image region detecting means con- 
trols, according to the supervising result of the supervising means, a size of each partial image region in the 
detection of the error partial image region. 
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